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Abstract — For several communication models, the dispersive 
part of a communication channel is described by a bilinear 
operation T between the possible sets of input signals and channel 
parameters. The received channel output has then to be identified 
from the image T(X,Y) of the input signal difference sets X and 
the channel state sets Y. The main goal in this contribution is to 
characterize the compressibility of T(X, Y) with respect to an 
ambient dimension N. In this paper we show that a restricted 
norm multiplicativity of T on all canonical subspaces X and 
Y with dimension S resp. F is sufficient for the reconstruc- 
tion of output signals with an overwhelming probability from 
0((S + F) log N) random sub-Gaussian measurements. Thus, 
in this case, the number of degrees of freedom of each output 
grows only additively instead of multiplicatively with the input 
dimensions (sparsity) S and F. This is a relevant improvement in 
the output compressibility and suggests a substantially reduced 
rate in compressed sampling algorithms. 

I. Introduction 

From an abstract point of view, a dispersive communication 
channel is given as a bilinear operation T(s, h) between the 
input signal s and the channel parameter h plus additive noise 
n. For example, on this action could be represented as a 
matrix multiplication, i.e. the received signal is then: 



Hs + n. 



and the corresponding channel matrix H G 



(1) 



pNxN 



is given 

by the action Hs = T(s, h). If the channel matrix is known 
at the receiver and the possible input signals s exhibit a 
linear structure the set of all outputs Hs is a linear space. 
However, if the channel matrix has unknown parameters and 
the signal set is for example only a union of subspaces, the 
set of all possible outputs usually looses its linearity and 
the receiver is thus confronted with the determination of r 
from a non-linear manifold. Then, in order to provide efficient 
sampling and reception in such a non-coherent setting, it is 
of fundamental importance to characterize the complexity of 
the output set and relate it to structural properties of the 
channel and of the possible transmit signals. In compressed 
sensing for example, such an assumption is the sparsity S of 
the signal set, i.e. the transmitter might operate in a peaky 
fashion and the data is concentrated only on unknown but 
small sets of S <C N sample points. Let us denote this union 
of so called canonical subspaces with Eg. Even more, the 
set of non-zero coefficients in the vector h € R N during 
transmission can be small as well, i.e. concentrated on subsets 
of cardinality F -C N such that h 6 Ep. The intrinsic 
dimension for sampling the signal r in ([TJ is S + F as soon 



the support of signal and channel coefficients are known to the 
transmitter, whereby the image of this particular subspaces 
under T is contained in some subspace up to dimension 
SF. In both cases an additional factor, logarithmic N, is 
necessary for the unknown location of the supports. However, 
in the worst case, the sparsity of the inputs to T behave 
multiplicatively. The essence of this contribution is to establish 
conditions on T under which the overall compressibility still 
behaves only additively in S and F. This has a relevant 
impact on the complexity of the output set T(Es,Ef) and 
hence substantially improve the rate in compressed sampling. 
Furthermore, understanding the coupling between two sparse 
sources directly generalizes to the coupling of finitely many 
sources. 

In their recent work Q], Hedge and Baraniuk considered 

l N , see Section 



III 



and 



(S, F)-sparse circular convolutions in '. 
formulated a restricted isometry property (RIP) for the set of 
all differences in the union of the image of all (S, F)-sparse 
circular convolutions. It turns out that their proof approach 
leads to difficult mathematical problems, which according to 
the authors' knowledge are still unsolved. Since the proof 
in (21 Lemma 5.1] relies on a linear structure, which may 
not be present for the image of bilinear maps, more strict 
conditions on T and the input sets X and Y are needed to 
control the norm of the output set. However, the authors could 
establish in this work the result of Hedge and Baraniuk for a 
certain restriction on Euclidean convex cones. Another special 
case occurs for S and F dimensional subspaces, which are 
"properly" separated. In this case, the image under the circular 
convolution is isomorphic to the set of all simple tensors, 
which in turn is isomorphic to the set of rank-1 operators from 
X to Y. Hence the main theorem implies certain results from 
the theory of rank-1 matrix recovery 0, ||4l, 0. Moreover, 
the developed framework applies to all bilinear operations 
which have a certain restricted norm multiplicativity property 
on convex cones in an arbitrary basis. This enables compressed 
sensing on "sparse" output sets, which can not be written as a 
finite union of subspaces, and leads to generalized structured 
sparsity models J6J, Q, 181 . 

The outline of this paper is as follow. In Section [II] the 
fundamental concept of bilinear maps T on finite dimen- 
sional Euclidean spaces is introduced. The authors formulate 
a sufficient condition in Definition [T] which ensures a better 
probability as in |2j for the RIP on the image of such bilinear 
maps. Some important and simple couplings T for certain 
communication scenarios are discussed in Section [Till Here the 



main result is applied to some channel models, e.g. circular 
convolutions, which establishes an additive behavior of the 
sparsity S and F of the signal inputs and channel states. 
Section [TV] concludes this work with a conjecture for the RIP 
on the image of all (S, F)-sparse circular convolutions. 



II. Main Result 



Every bilinear map T: R iv x K iv -> M iv is a binary 
operation on R N and defines therefore a multiplication on Mr. 
The N dimensional linear space (R N ,+,-,T) is then called 
an associative algebra^ over R. Since we are interested in a 
stable embedding of the output (image), we have to equip the 
algebra with a norm || ||. In our main Theorem [T] we need for 
the proof technique, based on |2|, a nesting in the ^ 2 -norm, 
i.e. we have to bound the norm of the output z by the product 
of the norms of the inputs x, y from below and above. This 
is a very strict property for algebras since this would imply 
that the nullspace of T is TV := (0,X) U (Y,0), i.e. T is 
non-singular on X x Y . If we remove all singularity points 
in X x Y we obtain a subset O C X x Y on which T is non- 
singular. But then there could still exist a sequence o„ 6 0\JV 
such that lim n T(o„) = 0. The following definition exclude 
such sequences and provides how close can be approached. 

Definition 1 (Restricted norm multiplicativity property) 
Let X,Y C R N . Then the bilinear map T: X x Y ->■ 
has the restricted norm multiplicativity property (RNMP), if 

|T(x,y)|| 



N 



< a : = sup inf 

OCXxY (x,y)eo\JV ||x|| ||y|| 

T(0)=T(X,Y) 

Moreover, we define the universal upper bound by 



/?:= 



inf 



(2) 



(3) 



(x,y)GXxY\A/- ||x|| ||y|| 

Remark 1: It is known [9|, that for finite-dimensional al- 
gebras there always exists (3 < oo. Obviously, (3 is always an 
upper bound on O and this simplification will become relevant 
in the proof of Theorem [I] If a = f3(— 1), then the norm is 
called multiplicative on O , but only few algebras are norm- 
multiplicative. 

Essentially, the implicit use of the set O removes the re- 
dundancy in representing T(X, Y), i.e. removing unnecessary 
direction pairs in X x Y. Surely, the exact determination of 
the set O is a combinatorial hard problem and depends on 
T as well as on the subsets X and Y. Moreover, this set in 
general lacks for linear or convex properties. 

A. Notation 

In the following we will only consider Mr 7 with standard 
inner product product and the corresponding Euclidean norm 
||x|| 2 := (x, x). For a given subset X C R N we will denote 
the shell in X with inner and outer radii a and f3 by X 01,13 := 
{xel a < ||x|| < (3} and abbreviate further X a := X°> a . 
The functional ||x|| denotes the cardinality of the support of 
x in the Euclidean basis {ej}^ 1 , i.e. the sparsity of x with 



is a 



respect to the Euclidean basis. A convex set X C 
convex cone if for every x 6 X and A > it follows Ax e X. 

'Similar constructions are possible for C ■ 



X has dimensionality S if the space spanX has dimension 
S. 

B. Main Theorem 

Our main theorem provides a generalized compressed sens- 
ing framework by a stable embedding of certain (S, F)-sparse 
signal models which can not be anymore described by K- 
sparse signal models T,k- Since T has the RNMP, there 
exists by Definition [T] a subset O C X x Y such that the 
representation by T and O leads to a stable embedding of 
channel outputs T(s, h) received over a fixed but unknown F- 
sparse channel state h e Y if the difference set of all channel 
outputs T(si — S2,h) is a subset of T(X,Y). 

Theorem 1: Let 2 < S,F,N,M e N with SF < N and 
X,Y C M. N are S resp. F dimensional convex cones. If the 
bilinear map T : X x Y — > R N has the restricted norm mul- 
tiplicativity property with bounds a and /?, then a realization 
of a sub-Gaussian matrix $ : R N -> R M with M < N and 
- 7V(0, l/M) fulfills for every z € T(X, Y) 



(i-*)H < < (i + *)IMI 



(4) 



for any 6 £ (0, 1) with probability 

> 1 - 2N(X\X^ d )N{Y\Y s / d )e- Co(s ^ M (5) 



and constants 

d = d(a, (3) 
c (S/2) 



l7£(2 + ^) , aj:f3 
1 12 , a = 

(3S 2 ~S 3 )/A8. 



(6) 
(7) 



Remark 2: Here N(X\X e ) := min{n | 3{pi}? =1 : X 1 C 
Uj(X e + pj} denotes the covering number of X 1 by the 
covering sets X e . The determination of the covering numbers 
is a Banach geometrical problem and well studied for various 
compact subsets of Banach-spaces [10]. 

Remark 3: To compute the probability for a mapping $ 
which is universal for all L = (^) (^) < N s+F canonical 
(S, F) dimensional convex cone pairs (X, Y) we apply the 
union bound technique. Once universal RNMP bounds for 
all L canonical cone pairs are found, we get the RIP with 
overwhelming probability for M = 0({S + F) log(iV)). 

Proof: The main idea follows the technique in (2], where 
Baraniuk et al. considered a linear subspace Z of Mr with a 
5/4-net R for Z 1 ' 1 and obtained by the measure concentration 
phenomenon of Gaussian matrices $, that for every re fj and 
any S € (0, 1) it holdsQ 



with probability 



l$r|| 



> 1 - 2e 



<f IMI 



-c„(S/2)M 



(8) 



(9) 



Both, the constant 5 and the dimension of Z determine then 
the cardinality of R, which is given by the covering number 
and yields the scaling of the exponential term in |9]). This idea 
can be used again on X and Y as well to get an upper bound 



2 every r £ and the inequality i 



is equivalent to ||$r| 



5/2 INI 



Figure 1. Net construction in the shells for covering the sphere in Z. 



on the cardinality of R, but now in terms of the covering 
numbers N(X 1 , X s ' d ) and N(Y 1 ,Y & / d ). For this we need 
to control the norm of z by elements in X x Y which is 
possible if T has the RNMP, since the set O does not contain 
"bad" representation pairs for Z := T(X, Y). It is in fact not 
necessary to give an explicit parametrization of O. The only 
information needed for the proof are the bounds a and /?. 

Every normalized z £ Z 1 ' 1 can be represented as an element 
from the image under T of O x := {o £ O | ||T(o)|| = 1} C 
X x Y. Since T has the RNMP on O we have by Definition [T] 
for (x,y) G Or. 

a||x||||y|| <l</3||x||||y||. (10) 

If we rescale the elements in the pair (x, y) £ 0\ by fi := ||x|| 
resp. yT 1 > and set x := x/fi G X 1 ' 1 and y := fiy £ Y 
(X and Y are cones), we get by bilinearity: 

T(x,y)=z = T(x,y) (11) 

and from absolute homogeneity of ||-| we have with (T0| : 

a||y|| <i</3||y|| => i<||y||<i. (12) 

p a 

Hence there exist a representation set for Z 1 ' 1 by pairs in 
X 1 ' 1 x y 1 // 3 - 1 / . Since a < 1 < /? we can also choose a 
representation set 0\ which is contained in the symmetrized 
set of convex shells X a - b x Y a ' b with common inner and outer 
radii a := /3~2 < 1 < a~2 =; b. 

Oi C Oi, x x O hY C X a - b x Y a '\ (13) 

where O^x and 0\ y are projections of Ojto X resp. y. 
These are axial lines in the shells, see Fig. Ill Note, that 0\ 
can not be written as a Cartesian product, since only certain 
pairs are allowed. 

The algebraic part of the proof goes as follows: Any 
realization of $ is a linear map on a finite-dimensional normed 
space M. N and hence bounded, i.e. there exist A > — 1 s.t. 

||$z|| < (1 + A)||z|| for all z e Z, (14) 

where 1 + A > denotes the smallest upper bound (operator 
norm of $ restricted to Z). If we can show that A < 5 we 
have shown the upper bound in Q. Since $ is linear and 
Z a cone (not necessarily convex), it is enough to find an 
upper bound in {14} for all z e Z 1 ' 1 . Let P C X a b and 
Q C Y a ' b be e-nets for X a ' b resp. Y a b with e G (0, 1) and 
define R := {T(p, q) : (p, q) e P x Q} c Z. It follows that 
\R\ < N{X b ,X t )N{Y b ,Y t ). Thus, every z e Z 14 can now 
be represented with ( fT3] l by a pair (x, y) e X a,fc x F a ' h with 



x e X e (p) := X e + p and y £ Y e (q) := Y c + q. The image 
T(X e (p), y e (q)) is the covering set of the point T(p, q) and 
the union forms a covering for Z 1 ' 1 by ( [T3| ). Note that this 
covering sets in Z are not necessarily convex! By using the 
triangle inequality and a zero addition in p, q we have for any 
T(p, q) G R that all z = T(x, y) G T(AT c (p), F e (q)) n Z 1 ' 1 
(i.e. (x,y) G Oi n X £ (p) x F e (q)) satisfy: 

|||$z||-||$T(p,q)|||< ||*(T(x-p,y-q))|| 

+ ||*(T(x - p,q))|| + ||4(T(p,y - q))|| . (15) 

Using the universal bound 1 + A in ([14} we obtain: 

<(l + A)(||T(p,y-q)|| + ||T(x-p,q)|| 

+ ||T(x-p,y-q)||) (16) 

and since x— p G X and y— q G Y we can apply the universal 
upper bound (3 of the RNMP in ^ to get: 

< (1 + A)0[ ||p|| ||y-q|| + ||q|| ||x-p|| + ||x-p|| ||y-q|| ] . 

Since (p, q) G X b x Y b is a e-net point-pair for (x, y), we get 

< (1 + A)(3 (be + be + e 2 ) < (1 + A)/3(2b + l)e. (17) 

If we define the constant c = c(a, fi) by: 

c:=j8(26 + l) =£(2/Va+l) > 1, (18) 

we obtain the upper bound 

||$z|| < (l+A)ce+||*T(p,q)||. (19) 

The main tool of the proof is the measure concentration in 
(jS). But there is no norm nesting ||T(p, q)|| since in general 
(Pi q) ^ Oi. Even if (p, q) G 0\ we don't get from 
( fT~3] > a tight scaling for vanishing e. Therefore we use the 
continuity property (bilinearity) of T to upper and lower bound 
||T(p, q)|| in terms of e for every Cartesian product of two 
convex covering sets X e (p),Y e (q). Let us define the pre- 
image of T(X e (p), F £ (q)) n Z 1 ' 1 by 

Z-\p,q) := {(xj)er(p)xr(q)no| 

If this set is not empty (otherwise (p, q) can be dropped from 
P x Q), just grap one pair (x, y) G Z _1 (p, q). But then there 
exisj^] (c, d) G X e x Y e s.t. (x, y) = (p + c, q + d) and so: 

||r( P) q)|| = ||T(x-c,y-d)|| 

= ||T(x, y) - T(x, d) - T(c, y) + T(c, d)|| . 

3 If X is a convex cone, then p is the aphex point of the covering set X e (p) 
which is again a convex cone (non-symmetrical), precisely tX 1 = X f - . Hence 
x — p S X e . If X is a linear space, then X'- is a ball (symmetric) with center 
at the origin and so x — p £ X" again. 



Since < ||c|| , ||d|| < e we get with ((3) the lower bound 

||T(p,q)|| > ||r(x,y)||-||r(x,d)||-||T(c,y)||-||T(c,d)|| 
> 1 - 2(3be - /3e 2 > 1 - /3(26 + l)e = 1 - ce 

and the upper bound 

||T(p,q)|| < ||T(x,y)|| + ||T(x,d)|| + ||T(c,y)|| + ||T(c,d)|| 
< 1 + 2/3be + (3e 2 < 1 + (3{2b + l)e = 1 + ce. 

Let us discuss the discontinuity of this norm estimation. If we 
have a = ft, hence norm multiplicativity, then we would get 
c = 3. But in fact, this is to bad, since the shells are now unit 
spheres and every p, q is normalized and hence by the norm 
multiplicativity T(p,q). But this gives c = 0. To respect this 
fact we define c and get for all net point pairs 



1-ce < ||T(p,q)|| < 1+ce 



a = P 



(20) 



Then we can use the measure concentration in |8) to obtain 
from ([19) and ( |20] > with probability larger than in (|9) 

||$z|| < (1 + A)ce + (1 + 5/2){l + ce) 
= 1 + Ace + ce + ce + 5(ce + l)/2. 

Now, by compactness, there exist a maximal z' € Z 1 ' such 
that equality in ( p~4] > is achieved. Hence we get 

2ce + ce(2 + 5) + 5 
2(1 - ce) ' 

Let us proceed by case distinction. If a = f3 then c = 0, c = 3. 
Defining e = < 1 with 5 e (0, 1) we get 



A< 



(21) 



A< 



3e 



1 - 3e 



8 

2 <<5. 



If we have a ^ (3 then c = 
with 5 e (0, 1) we get from |2Tj: 



c(a, (3). Defining e 



2 



5<5+7<5 5 



14 



<1 
< 



14' 
6 
7 



= 5. 



(22) 



< 1 



(23) 



1-ce ~ 1 - 
This upper bound holds with probability larger than 

> 1 - 2N{X\ X 5 ' d )N(Y\ y<Vrf) e -co(5/2)Af ^ 

V ; [12 , a = p 

The lower bound 1 — 8 follows from this with 

||$z|| > ||$r(p,q)||-(l+A)oe 

by considering all z e Z 11 we get by inserting ( |23] l and (|2^ 
with same probability as in p4| 



(24) 



(25) 



l$z|| > 1- 



^ \ /-, rN C( 5 

1 - C^ - (l + <5)^ . 

d(a,p)J d(a,f3) 



If a = (3 then c = 0, c = 3 and d = 12. This gives 

||$z|| > 1- 5/2 -8/2 = 1-5. 

If a 7^ (3 then c = c, d = 7c and 

5 - ce5 2c5 



(26) 



(27) 



$z > 1 



7c 



> 1 



The covering number N{X b ,X s / d ) remains the same if we 
scale both sets X b ,X 5 ^ by 1/& = y/a, ES Lemma 4.16] 
giving with d := d/^fa the <5-embedding with probability: 

> 1 - 2N(X 1 ,X^)N(Y 1 ,Y^ )e- Ca{ ^ )M 

III. Applications 
Before using the theorem we will discuss the following 
observations. A simple coupling T in ([TJ is given by the 
pointwise multiplication, e.g. a fading channel: 

T(s,h) =Hs = h0s:= (h Q s Q , Iin^sn-!) 7 



(28) 



with diagonal channel matrix H = diag(h). There, we have 
the norm inequality ||h0s|| < ||h|| ||s|| and (R N , +, 0, ||-||) 
becomes an unital commutative algebra with unit element 
I© = (1, . . . , 1) T . Unfortunately, one can not establish a lower 
norm multiplicativity bound a > on any disjoint convex 
subsets X, Y C R N . Hence we can not apply efficiently 
our theorem on these sets. But actually this is not necessary 
here, since for any S, F dimensional subspaces X, Y the 
output z has sparsity less than min{5, F} with respect to the 
Euclidean basis. In this simple case we can immediately apply 
the original Lemma 5.1 in to establish the RIP on X Y 
with probability 



> 1 - 2 (l2/5) nlhl{S ' F} e ~ c o(S/2)M_ 



(29) 



This easily extents to pointwise multiplications in another 
domains, i.e. for some given unitary matrix U we can define 
the new product (commutative as well): 

T(s,h) = \/]VU , (Us0Uh), (30) 

which obeys the following £ 2 -norm inequality: 



1 

N 



|T(s,h)|| 2 = ||U*(Us0Uh)|| 2 = £|(e i) Us)(Uh,e i 



< max |(e,', Us)| 2 ||h|| 2 < max | (e^-, Uej 

j id 

<iiuiiLii 

with IIUII 



Is|| 2 ||h|| 2 



maxjj Ke^Ue,)! and \\s\\i := E ? -I( s > e j/ 



Hence, by commutativity of T, we obtain for any unitary 
matrix U the upper estimate: 

||T(s, h)|| 2 <iV ||U||^ min{||s|| , ||h|| } ||s|| 2 ||h|| 2 . (31) 

a) Sparse Circular Convolutions: Let us consider multi- 
plication in the frequency domain, i.e. U = F is the Fourier- 
matrix with [F] ifc = e- 2 ™v /yOV for /, k € {0, . . . , N - 1}. 
Then T = © is the circular convolution in the time domain 
by (J30]>. With = 1/y/N we obtain from ((31) 

(32) 



|h®s|| 2 <min{||h|| ,||s|| }||h|| 2 ||s|| 2 . 



If s and h are sparse in the Fourier basis, we can proceed 
as before. But for (S, F)-sparsity in the time domain (with 
respect to the Euclidean basis) we need RNMP for ®. We 
call such a restricted circular convolution an (S, F)-sparse 
circular convolution, see Q~). In general there doesn't exists 
a lower bound a > for sparse circular convolutions, since 
the nullspace of T can contain elements (s, h) with s ^ 
and h ^ 0. One can prevent this behavior by restricting the 
domain of T to certain convex sets X,Y C M. N . 



b) Sparse Circular Convolutions on Positive Cones: 
If we assume the channel is only an on/off channel or a 
fading channel with positive parameters hi > and the signal 
parameters are also positive, then we can easily establish the 
following lower bound: 

||h©s|| 2 =^/ lj 2 4+ J2 h 3 h lS ke 3 s kel > ||h|| 2 ||s|| 2 . 

Hence we obtain together with < [32] > for positive inputs 

INN < l|h©s|| < ^min{S,F} ||h|| ||s|| . (33) 

The positive elements in span{e;}i e / with 7 C {0, . . . , N— 1} 
form a canonical (Euclidean) £ = |7|-dimensional positive 
convex cone X. If X and Y are canonical S resp. F dimen- 
sional positive convex cones, then we can apply our theorem 
with the norm bounds derived in ( [33) , to establish the RIP 
on X © Y. With a result of Rogers-Zhong ifTTIl and Rogers 
[12 1 we can find an upper bound for the covering number 
of S > 3 dimensional positive cones X 1 by N(X 1 , X e ) < 
(4/e) S 7SlogS. For S = 2 we can upper bound this by the 
covering number with S'-dim e-balls contained in X e , where 
e = e/(2\/2). Hence (3/e) 2 = (6^2/e) 2 e-balls resp. e-cones 
cover the whole unit ball and hence X 1 . But this number is 
less than (4/e) 2 141og2 and thus Rogers bound holds also for 
all S > 2. A rough estimate shows that Rogers bound can 
be upper bounded for S > 2 by (18/e) S . Since a = 1 and 
/? = y/mm{S, F} in Q we get d = d = 21/3 with (f24|. 
For e = S/d we can hence establish the RIP on X © Y by 
Theorem [T] with probability 

> 1 - 2 (378 v /min{S', F}/6^ S+F e ' Coi5 ^ M . (34) 

c) Sparse Circular Convolutions and Tensor Products: 
A main property of the circular convolution is that the 
image of Euclidean basis vectors (e^e^) is again an Eu- 
clidean basis vector. Let X := span{ei}i G / and Y := 
spanjejljg j with |7| = S and |J| = F. Then it is easy 
to show that X © Y = span{efc}fcg/©j where 7 © J := 
{ (i + j) mod N | i G I,j G J}. If |7 © J| = ST then the 
subspaces X, Y are "properly" separated [1] and one can 
show easily that the image is Hilbert isomorph (isometric) to 
the set of all simple tensor products. This means, there exist 
isomorphism, s.t. on these extremal pairs (X, Y) the norm ||-|| 
becomes multiplicatively. Hence we get for all (s, h) G X x Y 

||s©h|| = ||s||||h||. (35) 

Here we use the fact, that every simple tensor s © h has a 
unique representation up to scalars by s and h, lfl~3l . This 
implies a norm multiplicativity, i.e. ||s©h| = ||s||||h||. 

The covering number for an S dimensional ball X 1 C R N 
with X e can be upper bounded by N(X 1 , X e ) < (3/e) 5 IfTOl . 
Together with the norm multiplicativity ( |35] >, 1 = a = P, we 
get d = 12 and obtain by Theorem [T] as probability bound 



IV. Conclusions 

In many communication schemes the coupling of channel- 
and signal parameters is given by bilinear maps T and sparsity 
is present in both inputs to T. It is therefore of general interest 
for several engineering applications to characterize the com- 
pressibility of the whole output set. In this paper we provide 
such a characterization once the RNMP can be established, 
uniformly or in some probabilistic setting. However, a uniform 
treatment of the exemplary case of (S, F)-sparse circular 
convolutions is still an open problem. It is also not fully 
understood whether the RNMP is only a sufficient or really a 
necessary condition for a scaling with 0(S + F). In particular, 
it is important to know whether to the following conjecture is 
true: Let (X, Y) be (S, i^)-sparse canonical subspaces in K. 
(S, F > 2). Does then any realization of a sub-Gaussian matrix 
$ : R N — > R M with M <N and [<% - W(0, l/M) fulfills 
for every z G X © Y 

(l-5)||z|| 2 <||$z|| 2 <(l + £)||z|| 2 (37) 

with failure probability Pe < 2 (d/S) s+F e -=o(<5/2)M for some 
fixed constant d > 1 and every 5 G (0, 1)? 

Acknowledgment 

The authors would like to thank Holger Boche and David 
Gross for their helpful discussion on this topic. This work 
was partly supported by the Deutsche Forschungsgemeinschaft 
(DFG) grants Bo 1734/13-1 and JU 2795/1-1&2. 

References 

[1] C. Hegde and R. G. Baraniuk, "Sampling and recovery of pulse streams," 
IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1505-1517, April 2011. 

[2] R. G. Baraniuk, M. Davenport, R. DeVore, and M. Wakin, "A simple 
proof of the restricted isometry property for random matrices," Con- 
structive Approximation, vol. 28, no. 3, pp. 253-263, January 2008. 

[3] B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed minimum-rank 
solutions of linear matrix equations via nuclear norm minimization," 
SIAM Journal on Applied Mathematics, vol. 52, pp. 471-501, 2010. 

[4] E. J. Candes and T. Tao, "The power of convex relaxation: Near-optimal 
matrix completion," IEEE Trans. Inf. Theory, vol. 56, pp. 2053-2080, 
2010. 

[5] D. Gross, "Recovering low-rank matrices from few coefficients in any 

basis," IEEE Trans. Inf. Theory, vol. 57, pp. 1548 - 1566, 2011. 
[6] R. Baraniuk and M. Wakin, "Random projections of smooth manifolds," 

Foundations of Computational Mathematics, vol. 9, pp. 51-77, 2009. 
[7] M. F. Duarte and Y. C. Eldar, "Structured compressed sensing: From 

theory to applications," IEEE Trans. Signal Process., vol. 59, pp. 4053 

- 4085,2011. 

[8] R. Baraniuk, V. Cevher, and M. Wakin, "Low-dimensional models for 
dimensionality reduction and signal recovery: A geometric perspective," 
Proceedings of the IEEE, vol. 98, pp. 959-971, 2010. 
[9] R. Arens, M. Goldberg, and W. Luxemburg, "Multiplicativity factors for 
seminorms. II," Journal of Mathematical Analysis and Applications, vol. 
170, pp. 401-413, 1992. 

[10] G. Pisier, The volume of convex bodies and Banach space geometry. 
Cambridge University Press, 1989. 

[11] C. A. Rogers and C. Zong, "Covering convex bodies by translates of 
convex bodies," Mathematika, vol. 44, pp. 215-218, 1997. 

[12] C. Rogers, "A note on coverings," Mathematika, vol. 4, pp. 1—6, 1957. 

[13] W. Greub, Multilinear algebra. Springer, 1967. 



> 1-2(36A5) S+F e- C0 ^ 2 > 



(36) 



